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I.  SUMMARY  OF  RESEARCH  OBJECTIVES 


Stochastic  point  processes  are  models  of  points  distributed 
randomly  in  some  space;  these  points  may  represent,  for  example, 
locations  (or  even  trajectories)  of  tracked  objects,  ti mes  and  amounts 
of  precipitation  events,  or  failure  times  and  modes  of  a  complex 
system.  This  research  project  is  directed  toward  two  principal 
problems  arising  in  applications  of  point  processes:  statistical 
inference  for  point  processes  whose  probability  law  is  unknown  entirely 
or  in  part,  and  state  estimation  for  partially  observed  point 
processes,  i.e.,  minimum  mean  squared  error  reconstruction, 
realization-by-realisation,  of  random  variables  that  are  not  directly 
observable.  These  problems  are  examined  in  several  (not  disjoint) 
contexts:  stationary  point  processes,  Cox  processes,  multiplicative 
intensity  processes  and  Poisson  processes.  Another  thrust  of  the 
research  is  inference  for  stochastic  processes  based  on  point  process 
samples,  with  the  particular  goal  to  investigate  inference  and  state 
estimation  for  random  fields  given  point  process  samples. 


II.  RESEARCH  ACCOMPLISHMENTS 

Research  during  1984  has  focussed  on  six  major  problem  areas. 

A )  Inference  for  Stationary  Point  Processes.  Let  M  be  a 
stationary  point  process  on  E  =  0?^,  dM,  and  consider  the  statistical 
modal  ?  of  probability  measures  p  under  which  N  is  stationary: 

M  -  NX  1  for  each  x,  where  X^  is  the  translation  y*y-x.  For  each 

* 

P-:f  let  P  be  the  Pa  fa  measure,  i.e.,  the  u;ji,qu|  ini  j^.e,  « 

<  1  ”  1  •  * 1  •  *  %/  '  •  *  •  •’ 

l;u  •  *  * 

i  .. 

i  ■  ‘  V  '  •  *  ...» 

vla  r  Tt&H  J .  - 

Chief,  lathnienl  Inforeatioa  Diviaion 


such  that  tor  each  (bounded,  measurable)  function  H, 


<1'  E C  Jh  < N 1 , x ) N ( dx ) 1  =  E*[jH(N,x)d*3, 

♦  #  * 

where  E  denotes  "expectation"  with  respect  to  P  ,  even  though  P  need 

not  be  a  probability,  and  d:<  (and  below,  X)  denotes  Lebesgue  measure. 

Hour  1  st  1  cal  1  y  ,  P  CN-:  ( •  )  1  /P*  ( ii)  =  P  (Me  <  ■ )  1 N  ( {0) )  =  1)  ,  so  that  P*  is  the 

"law"  of  N  conditional  on  the  null  event  that  there  is  a  point  at  the 

origin.  Extending  work  of  Krickeberg  (1982),  a  theory  of  estimation 

for  stationary  point  processes  has  been  developed  in  which  objects 

estimated  are  the  Palm  measure  and  integral  functionals  of  it, 

especially  moment  and  spectral  measures.  Data  are  single  realizations 

of  N  observed  over  increasing  compact  sets. 

Specifically  (cf.  Karr,  1985,  or  Krickeberg,  1982,  for 

background),  with  (d>:  ^ , . .  .  ,  dx  ^ )  =  N  (d:<  j )  ■  - -N  ( d  x  k )  ,  let  p^  =  EtNk]  be 

k  k-1 

the  k-th  order  moment  measure  and  let  p#,  defined  on  E  ,  be  the 
reduced  noaent  a e asur e  of  order  k : 


k 


-  J 


E  h  - 


\?p#(dz)  , 


where  X^  is  the  image  of  X  under  the  mapping  x  +  (Zj+x,...,Zj,_j  +  x,x). 

The  reduced  moment  measures  of  orders  one  and  two,  to  wit  p*  =  ve^, 

2 

where  v  is  the  intensity  of  N  < E C N (A) ]  =  vX (A)  for  each  A)  and  p#, 

2  2 

along  with  the  reduced  covariance  measure  p  -  p  -v  X,  are  of  central 
importance,  as  is  the  spectral  measure  F,  which  satisfies  F(Y>  *  p^(Y) 

0)  A 

where  Y  is  a  C  -function  with  compact  support  and  Y  is  its  inverse 
Fourier  transform. 


The  unbiased  estimators 


•t  i  S 


£*(H>  =  X  ( K )  1  LH(MT_1)N<dx)  3 
•If  x 


of  the  Palm  measure,  where  K  is  a  compact,  convex  set,  are  natural 
“empirical"  estimators:  for  x  a  point  of  N  --  and  only  such  x 
contribute  to  the  integral  --  NX  *  has  a  point  at  the  origin,  so  that 

A# 

P  (H)  is  simply  an  average  of  H-values  for  translations  of  N  placing 
each  point  in  K  at  the  origin.  Here  K  should  be  regarded,  albeit 
loosely,  as  the  sample  size;  calculation  of  the  estimator  requires 
observation  of  N  over  a  compact  set  related  to  but  ordinarily  larger 
than  K . 

a# 

Strong  consistency  of  the  P  (H)  has  been  established,  uniformly  in 
H  over  certain  classes  of  functions,  under  broadly  fulfilled  conditions 
on  N ,  as  has  asymptotic  normality  of  the  "standardized"  estimation 
error  X  <K!  *^CP*  (H) -P*  (H)  3  ,  as  the  sets  K  increase  to  E.  Detailed 

A 

properties  of  the  estimators  v  =  N(K)/X(K>  and 

S*(f)  =  X(K)"1  J  N(dx)  |N(dy)f  (y-x)  ,  wher  e  f  is  continuous  with 

compact  support,  have  been  worked  out;  the  latter  yield  properties  of 

A  A  2  A. 

substitution  estimators  F(Y)  =  p^fT)  of  the  spectral  measure.  These 
results  appear  in 

Karr,  A.F.,  Estimation  of  Palm  measures  and  spectral  measures 
of  stationary  point  processes.  Technical  report  403, 
Department  of  Mathematical  Sciences,  The  Johns  Hopkins 
University,  1984, 

which  contains  further  material  concerning  the  problem  of  combined 
inference  and  linear  state  estimation,  i.e.,  linear  reconstruction  of 
unobserved  portions  of  N  when  v  and  p --  the  only  objects  required  for 
linear  state  estimation  --  are  unknown  and  must  be  estimated.  This 
manuscript  is  currently  unden  revision  for  Z .  Uahr  sc  he  ii>  1  i  cb- 


ke itstheor  ie  und  veru.  Geb.  to  incorporate  recently  proved  results  on 
Poisson  approximations  that  complement  the  central  limit  theorem  and  on 

ft 

estimation  of  P  (the  law  of  N)  itself,  rather  than  the  Palm  measure  P  . 

B)  State  Estimation  for  Cox  Processes.  A  pair  (N,M)  comprising  a 
simple  point  process  N  and  diffuse  random  measure  M  on  the  same  space  E 
is  a  Cox  pair  if  conditional  an  M,  N  is  a  Poisson  process  with  mean 
measure  li;  N  is  then  termed  a  Cox  process  directed  by  M.  The  most 
important  special  case  is  that  of  mixed  Poisson  processes,  in  which 

ft  ft 

M  =  yv  ,  where  v  is  a  diffuse  measure  on  E  and  Y  is  a  nonnegative 

random  variable.  In  applications,  which  include  signal  processing, 

carcinogenesis  and  precipitation,  only  the  Cox  process  N  is  observable, 

but  the  directing  measure  M ,  which  represents  the  underlying  physical 

mechanism,  is  of  primary  interest,  leading  to  the  state  estisation 

problem  of  computation  of  minimum  mean  squared  error  state  estimators 
N  N 

ECMi'j  (A)],  where  'J  (A)  is  the  o-algebra  corresponding  to  (uncorrupted) 
observation  of  N  over  the  set  A.  Such  computations  require 
(effectively  full)  knowledge  of  the  law  of  N,  which  of  course  typically 
is  not  available. 

An  optimal  solution  to  the  problem  of  combined  nonparametric 
inference  and  state  estimation  for  mixed  Poisson  processes  was  obtained 
in  Karr  (1904).  One  has  as  data  i.i.d.  mixed  Poisson  processes  N.  , 

ft 

with  unobservable  directing  measures  M.  =  Y. v  .  where  the  Y.  are  i.i.d. 

11  1 

with  unknown  distribution  F.  For  each  n  the  true  state  estimator  of 

M  is  expressible  as 
n+  1 

12,  EtMn*l ""  ’  ■  HIF’v*'N„.lls', 
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where  H  is  a  known  functional  form;  in  the  combined  problem  it  is 


replaced  by  a  pseudo-state  estimator 


(3) 


A  A*  * 

where  F,  v  are  estimators  of  F,  v  based  on  N......N  . 

I  n 

During  1984  a  partial  but  evidently  1 ess-than-opti mal  solution  was 
obtained  for  the  corresponding  problem  for  completely  general  Cox 
processes.  Its  key  components  are  a  representation  --  itself 
significant  --  for  true  state  estimators  in  terms  of  the  Pain 
distributions  (see,  e.g.,  Kallenberg,  1983,  or  Karr,  1985)  of  the 

M.  ,  which  are  linked  in  turn  to  the  reduced  Palm  distributions  of  the 

N.  ,  and  a  methodology  for  estimating  the  latter  from  observation  of  the 

N . .  Estimation  is  effected  with  techniques  similar  conceptually,  but 

very  different  mathematically,  to  those  discussed  in  II. A  above.  The 

representation  theorem  yields  an  analogue  for  the  function  H  in  (2)  and 

(3);  the  other  main  results  are  limit  theorems  describing  asymptotic 

behavior  (as  n*®)  of  differences  between  true  state  estimators  and 

pseudo-state  estimators.  They  appear  in 

Karr,  4.F.,  State  estimation  for  Cox  processes  with  unknown 
probability  law.  Technical  report  379,  Department  of 
Mathematical  Sciences,  The  Johns  Hopkins  University, 
1984, 

which  has.  been  accepted  for  publication  in  Stochastic  Processes  and 
their  App  1  icat  i  o  r, •  s  . 


C)  Multiplicative  Intensity  Models.  In  the  theory  of 
intensity-based  inference  for  point  processes  on  R  ,  the  best 
compromise  between  applicability  and  tractabi 1 i ty  is  the  multiplicative 


intensity  model  of  Aalen  < 1 9 7B )  (see  Jacobsen,  1982,  or  Karr,  1985,  for 

general  discussion).  Let  ( ft , 3 , P )  be  a  probability  space  on  which  are 

defined  a  point  process  (Nf  )  and  filtration  ( }?t ) .  Provided  that  it 

exists,  the  stochastic  intensity  of  N  is  the  unique  (predictable) 

ft 

process  (X^)  such  that  =  N^-j^.X^ds  is  a  martingale. 

Heur  i  st  i  cal  1  y,  X^dt  =  ECaN^IH^I,  where  aN^  is  the  jump  (necessarily 

one  or  zero)  of  N  at  t;  the  differential  form  d =  dN^-X^dt  reveals 

the  "innovation"  interpretation  of  the  martingale  M.  In  the 

multiplicative  intensity  model  the  unknown  "parameter"  is  a 

positive  function  cceL*  1 0, 1 1 ;  under  the  probability  P  ,  N  has  stochastic 

intensity  ia^X^),  where  X  is  an  observable,  predictable  process.  The 

ft 

"martingale  method"  of  inference  estimates  integrals  j^a^ds  (more 

rt 

precisely,  random  processes  B  ^  < « >  =  J ftl ( X^XO) «  ds)  with  martingale 

A  -  1 

estimators  B.= 1.1 (X  >0) X  dN  ,  whose  main  attractions  are 
t  J  v  s  s  s’ 

A 

computational  simplicity  and  the  property  that  (B^-B^(a))  is  a 
P  -mar t i ngal e  for  each  a;  the  latter  permits  calculation  of  variances 
and  application  of  potent  martingale  central  limit  theorems  to  develop 
asymptotic  properties  of  martingale  estimators. 

However,  martingale  estimators  are  not  derived  from  optimality 
considerations.  By  adapting  the  method  of  sieves  of  Grenander 
(1981)  and  collaborators,  it  has  been  possible  --  in  the  context  of 
1.1. d.  multiplicative  intensity  processes  --  to  construct  maximum 
likelihood  estimators  that  are  strongly  consistent  in  the  sense  that 
I  ot  -  I?  j  ■*  0  almost  surely.  Further  results  that  identify  conditions 

engendering  c  -consistency ,  local  asymptotic  normality  of  likelihood 

/. 

ratios  and  asymptotic  normality  of  the  a  have  also  been  obtained.  A 


t 


- - 


preliminary  report 

Karr,  A.F.,  Maximum  likelihood  estimation  in  the  multiplicative 
intensity  model,  via  sieves.  Technical  report  46, 

Center  Tor  Stochastic  Processes,  University  of  Morth 
Carol  1 na  ,  1993, 

written  during  a  sabbatical  visit  in  Fall,  1983,  has  fceea  revised  and 
expanded  during  1984;  this  new  version  has  been  accepted  for 
publication  in  The  anna’s  of  Statistics. 

D)  Poisson  Processes.  Consider  a  Poisson  process  N  =  2c ,  ,  on 

V  A  l  ,  Z  i  ) 

a  product  space  E  =  E^Ej  with  mean  measure  p  ( d:< )  K  (x  ,  dy )  ,  where  K  is 
a  known  transition  probability  from  E(.(  to  E^  and  p  is  an  unknown 
measure  on  Efj ,  and  suppose  that  only  the  second  component  N  *  =  It^  is 
observable.  The  goal  is  inference  concerning  u,  the  mean  measure  of 
the  Foisson  process  ir  =  It  ,  given  observation  of  n  i.i.d.  copies  of 

A  1 

N  .  Applications  of  this  model  include  positron  emission  tomography 

(Shepp/Vardi  ,  1982)  and  other  forms  of  medical  imaging  (D.L.  Snyder, 

personal  communication).  Estimation  of  p  via  the  Eli  algorithm  of 

Dempster/Laird/F;ubin  (  1977)  is  under  investigation;  this  iterative 

algorithm  (for  each  fixed  value  of  n)  uses  a  provisional  estimate  of  p 

a  0  N 1 

to  construct  a  pseudo-state  estimator  E C N  ] ,  which  is  used  in  turn 

to  update  the  estimated  value  of  p.  With  n  fixed,  this  procedure 
converges  in  some  cases  to  a  maximum  likelihood  estimator  of  p.  The 
)e>  issue,  consistent  estimation  of  p  as  n -» * ,  renains  unresolved 
despite  progress  during  1984;  completion  of  this  research  during  1985 
is  anticipated. 


y 


E) 


V 


F:  a  n  d  o  in 


Fields.  A  random  field  is  a  stochastic  process 


th  a  multidimensional  (Euclidean)  pa-ameter  set. 
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Suppose  fiat  y  is  a  stationary  random  field  on  !Rd  that  can  be  observed 
only  at  the  points  X^  of  a  stationary  Poisson  process  N  on  that  is 
independent  of  V;  more  precisely,  N  is  also  observable,  so  that 
observations  constitute  a  marled  point  process  in  which  each  point  of 
the  sampling  process  N  is  marked  by  the  value  of  y  at  the  point.  For 
example,  V  may  be  a  precipitation  field  and  the  Xj  locations  of 
raingages,  or  '/  a  petroleum  reservoir  and  the  X.  locations  of  test 
drillings. 

Techniques  have  been  developed  for  estimation  of  the  mean 
m  =  E t  >  1  and  the  covariance  function  R ( x )  =  Cov(y  ,y  )  given 
observation  of  single  realizations  over  compact,  convex  sets  K,  even  if 

A  “Ip 

the  intensity  v  of  N  is  unknown.  The  estimators  m  =  N(K)  J^.ydN, 
usable  regardless  of  whether  v  is  known,  are  mean  square  consistent  and 
asymptotically  normal  under  minimal  assumptions.  Similarly,  given  that 
n  =  0  and  v  is  known,  the  nonpar ametri c  estimators 

A  2  - 1  r  r  12) 

R(x)  =  Cv  X  ( K )  3  J  (x -x  j  +x7 )  y  (x  j )  y  (x  ? )  N  (dx^dx^), 

1 2 )  -  ^ 

where  N  (dx  ,dx„)  =  N(dx  )  (N-e  )  (dx„)  and  w  (x)  =  a...  wix/a  )  is  a 
1  l  i  X  i  Z  r.  K  K 

"window’’  function  (w  is  a  bounded,  isotropic  density  and  the  a  are 

K 

positive  constants  converging  to  zero)  are,  again  under  only  mild 
restrictions,  mean  square  consistent,  asymptotically  normal  pointwise 
in  x  and  asymptotically  uncorrelated  for  x  t  ±x ' .  These  properties, 
alternative  estimators  of  R  via  the  signed  measure  Gift)  =  J^R ( x ) dx 
and  linear  state  estimation  of  unobserved  values  of  y,  are  treated  in 

Karr,  fi.F.,  Inference  for  stationary  random  fields  based  on 
Poisson  samples.  Technical  report  xxx,  Department  of 
Mathematical  Sciences,  The  Johns  Hopkins  University, 

193b, 


8 


which  will  shortly  be  submitted  for  publication  in  Advances  iri 
Applied  Probability. 


Though  unrelated  to  the  preceding  topics  the  following  research 
activity  synthesizes  several  lines  of  inquiry. 

F )  Stopping  Times  of  Harkov  Processes.  The  structure  of  stopping 
times  of  a  Markov  process  is  central  not  only  to  such  theoretical 
issues  as  the  strong  Markov  property  but  also  to  applications, 
including  optimal  stopping,  stochastic  orderings  and  "inverse 
problems";  see,  e.g.,  Karr /Pi ttenger  (1978,  1979).  In  the  manuscript 

Karr,  A.F.,  and  Pittenger,  A.O.,  Structural  properties  of 
random  times.  Technical  report  xxx,  Department  of 
Mathematical  Sciences,  The  Johns  Hopkins  Universit 
1985, 

an  algebraic  structure  is  devised  that  elucidates  the  nature  of  natur _ 
and  randomized  stopping  times,  especially  randomized  terminal  times  and 
the  new  class  of  randomized  quasi -terminal  times,  extreme  randomized 
terminal  times  are  identified,  and  a  sequential  compactness  theorem  is 
established.  Unfortunately,  no  "real"  applications  are  apparent  or 
imminent.  This  manuscript  will  be  submitted  to  Z.  Uahr  sche in  I ich- 
ke itstbeor ie  and  v e r w .  Cab . 

III.  PAPERS  APPEARING  DURING  1984 

During  1984  the  following  papers  supported  by  grants  from  AFOSR 
appeared  in  print: 

1)  Karr,  A.F.,  Estimation  and  reconstruction  for  zero-one  Markov 
processes.  Stochast  ic  Process .  App ! .  16  219-255. 


2)  Karr,  A.F.,  Combined  nonpar ametr i c  inference  and  state 
estimation  for  mixed  Poisson  processes.  Z.  Hahr  sche  m 1 ichke itsiheor ie 
un  d  vet  w .  C  e  b  .  66  81-96. 


IV.  ADDITIONAL  ACTIVITIES 

The  following  activities,  even  though  they  either  do  not  receive 
ArOSR  funding  or  do  not  result  (directly)  in  publications  containing 
new  results,  are  nevertheless  integral  to  the  research  program  and  are 
evidence  of  its  vitality. 

1 )  Boot ■  The  book  Point  Processes  and  their  Statistical 
Inference ,  by  A.F.  Karr,  W3S  completed  in  October,  1994;  it  is  to  be 
published  in  late  1995  by  Marcel  Dekker,  Inc.  Although  its  writing  has 
not  been  supported  by  AFOSR  the  book  contains  new  results  that  will  not 
(for  various  reasons)  be  published  elsewhere.  Nearly  all  of  these  are 
outgrowths  of  AFOSR-suppor ted  research  and  will  be  so  acknowledged. 

2)  Expository  Papers.  The  papers 

Karr,  A.F.,  The  martingale  method:  introductory  sketch  and 
access  to  the  literature.  Operations  Res.  Letters  3 
(1984)  59-63. 

Karr,  A . F .  ,  Point  process.  In  Encyclopedia  of  Statistical 

Sciences  VI,  N.L.  Johnson  and  S.  Kate,  eds.  Wiley,  New 
York  'to  appear). 

) a r r  ,  A . F .  ,  Poisson  process.  In  Encyclopedia  of  Statistical 
Sciences  VI,  N.L.  Johnson  and  S.  Kotz,  eds.  Wiley,  New 
York  (to  appear). 

Farr,  A.F.,  Stationary  point  process.  In  Encyclopedia  of 

Statistical  Sciences  VI,  N.L.  Johnson  and  S.  Kotz ,  eds. 
Wiley,  New  York  (to  appear', 

which  ?rp  expository  presentations  of  point  processes  and  inference  for 
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them,  have  likewise  not  been  prepared  under  AF03R  support.  However, 
each  is  an  invited  contribution  and  contains  substantial  discussion  of 
supported  research.  That  they  are  invited  papers  confirms  the 
visibility  and  strong  reputation  of  the  research  program. 

3)  Seminar  and  Conference  Presentations.  Invited  seminar  and 
conference  addresses  on  the  research  accomplishments  discussed  in  II 
were  presented  during  1984  at  The  Johns  Hopkins  University,  the  Centre 
for  Mathematics  and  Computer  Science  (Amsterdam),  the  University  of 
Copenhagen,  the  Ecole  F'olytechnique  (Paris),  a  Mini-conference  on 
Inference  for  Stochastic  Processes  (Lexington,  KY)  and  the  Fourteenth 
Conference  on  Stochastic  Processes  and  their  Applications  (Goteborg). 

4)  Visitors  to  Johns  Hopkins.  During  1934  visitors  to  Johns 
Hopkins  for  discussion  of  inference  for  point  processes  included  D. 
Kdnig  (Freiberg,  DDR),  D.J.  Daley  (Canberra)  ,  P.E,  Greenwood 
(Vancouver),  A.N.  Shiryayev  (Moscow),  E.  Arjas  (Oulu,  Finland)  and  S. 
Johansen  (Copenhagen).  None  of  these  visits  received  grant  support  (it 
does  not  include  such  funds);  the  international  stature  of  the  visitors 
and  their  willingness  to  visit  even  without  support  are  further 
indication  of  the  strength  of  this  research  program. 
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